Formal Modeling of Connectionism using Concurrency Theory, an Approach Based on Automata and Model Checking

This paper illustrates a framework for applying formal methods techniques, which are symbolic in nature, to specifying and verifying neural networks, which are sub-symbolic in nature. The paper describes a communicating automata [Bowman & Gomez, 2006] model of neural networks. We also implement the model using timed automata [Alur & Dill, 1994] and then undertake a verification of these models using the model checker Uppaal [Pettersson, 2000] in order to evaluate the performance of learning algorithms. This paper also presents discussion of a number of broad issues concerning cognitive neuroscience and the debate as to whether symbolic processing or connectionism is a suitable representation of cognitive systems. Additionally, the issue of integrating symbolic techniques, such as formal methods, with complex neural networks is discussed. We then argue that symbolic verifications may give theoretically well-founded ways to evaluate and justify neural learning systems in the field of both theoretical research and real world applications

Rapid presentation rate negatively impacts the contiguity effect in free recall

It is well-known that in free recall participants tend to recall words presented close together in time in sequence, reflecting a form of temporal binding in memory. This contiguity effect is robust, having been observed across many different experimental manipulations. In order to explore a potential boundary on the contiguity effect, participants performed a free recall task in which items were presented at rates ranging from 2 Hz to 8 Hz. Participants were still able to recall items even at the fastest presentation rate, though accuracy decreased. Importantly, the contiguity effect flattened as presentation rates increased. These findings illuminate possible constraints on the temporal encoding of episodic memories.http://sites.bu.edu/tcn/files/2019/05/RSVP_FR.pdfAccepted manuscrip

Modeling the neural circuitry underlying the behavioral and EEG correlates of attentional capture

The Reactive-Convergent Gradient Field model (R-CGF) is a unique approach to modeling spatial attention in that it links neural mechanisms to event related potentials (ERPs) from scalp EEG. This model was developed with the aim of explaining different, sometimes conflicting, findings in the attention literature. Specifically, this model address conflicting findings showing both simultaneous and serial deployment of attention. Another argument addressed by the model is whether attention to a location invokes a suppression of the spatial surround, or the selective inhibition of distractors. With the R-CGF, we have found that these results are not as incompatible as they appear but rather can both result from a common set of mechanisms in different kinds of experiments. The model has three main neural sheets, early vision (EV), late vision (LV) and a master attention map (AM), connected spatiotopically. The LV layers are specialized for different features (e.g. shape or color) with modulated connections to the AM depending on task requirements. The AM implements a reactive inhibitory circuit through gating neurons that suppresses attention selectively at the location of distractors that are proximal to the target

RSVP in orbit: Identification of single and dual targets in motion

Three experiments using rapid serial visual presentation (RSVP) tested participants' ability to detect targets in streams that are in motion. These experiments compared the ability to identify moving versus stationary RSVP targets and examined the attentional blink with pairs of targets that were moving or stationary. One condition presented RSVP streams in the center of the screen; a second condition used an RSVP that was orbiting in a circle, with participants instructed to follow the stream with their eyes; and a third condition had participants fixate in the middle while observing a circling RSVP stream. Relative to performance in stationary RSVP streams, participants were not markedly impaired in detecting single targets in RSVP streams that were moving, either with or without instructions to pursue the motion. In streams with two targets, a normal attentional blink effect was observed when participants were instructed to pursue the moving stream. When participants had to maintain central fixation as the RSVP stream moved, the attentional blink was nearly absent even when a trailing mask was added. We suggest that the reduction of the attentional blink for moving RSVP streams may reflect a reduced ability to perceive the temporal boundaries of the individual items

Beyond a Mask and Against the Bottleneck: Retroactive Dual-Task Interference During Working Memory Consolidation of a Masked Visual Target

While studies on visual memory commonly assume that the consolidation of a visual stimulus into working memory is interrupted by a trailing mask, studies on dual-task interference suggest that the consolidation of a stimulus can continue for several hundred milliseconds after a mask. As a result, estimates of the time course of working memory consolidation differ more than an order of magnitude. Here, we contrasted these opposing views by examining if and for how long the processing of a masked display of visual stimuli can be disturbed by a trailing 2-alternative forced choice task (2-AFC; a color discrimination task or a visual or auditory parity judgment task). The results showed that the presence of the 2-AFC task produced a pronounced retroactive interference effect that dissipated across stimulus onset asynchronies of 250-1,000 ms, indicating that the processing elicited by the 2-AFC task interfered with the gradual consolidation of the earlier shown stimuli. Furthermore, this interference effect occurred regardless of whether the to-be-remembered stimuli comprised a string of letters or an unfamiliar complex visual shape, and it occurred regardless of whether these stimuli were masked. Conversely, the interference effect was reduced when the memory load for the 1st task was reduced, or when the 2nd task was a color detection task that did not require decision making. Taken together, these findings show that the formation of a durable and consciously accessible working memory trace for a briefly shown visual stimulus can be disturbed by a trailing 2-AFC task for up to several hundred milliseconds after the stimulus has been masked. By implication, the current findings challenge the common view that working memory consolidation involves an immutable central processing bottleneck, and they also make clear that consolidation does not stop when a stimulus is masked

Attention is more than prediction precision [Commentary on target article]

A cornerstone of the target article is that, in a predictive coding framework, attention can be modelled by weighting prediction error with a measure of precision. We argue that this is not a complete explanation, especially in the light of ERP (event-related potentials) data showing large evoked responses for frequently presented target stimuli, which thus are predicted

Picture Detection in RSVP: Features or Identity?

A pictured object can be readily detected in a rapid serial visual presentation sequence when the target is specified by a superordinate category name such as animal or vehicle. Are category features the initial basis for detection, with identification of the specific object occurring in a second stage (Evans & Treisman, 2005), or is identification of the object the basis for detection? When 2 targets in the same superordinate category are presented successively (lag 1), only the identification-first hypothesis predicts lag 1 sparing of the second target. The results of 2 experiments with novel pictures and a wide range of categories supported the identification-first hypothesis and a transient-attention model of lag 1 sparing and the attentional blink (Wyble, Bowman, & Potter, 2009)National Institute of Mental Health (U.S.) (grant MH47432

On the limits of evidence accumulation of the preconscious percept

When a stimulus is repeated the memory representation for that stimulus is strengthened and performance in memory tests increases. To what extent this effect requires that each exposure elicits a fully-fledged conscious percept? In two Rapid Serial Visual Presentation (RSVP) experiments we explored whether the memory representations for words would accumulate evidence trough repeated exposure when none of those presentations induced a conscious percept. Participants were instructed to identify repeated items inserted in different RSVP streams and we isolated the first instance that an item was consciously perceived as repeating. The results showed that the probability of detecting a repetition for the first time was constant across repetitions. This effect signals a limit to the evidence accumulation process through repeated exposure. We discuss whether conscious perception modulates the decay of memory representations with below-threshold items resulting in extremely fleeting memory representations

Understanding visual attention with RAGNAROC: A Reflexive Attention Gradient through Neural AttRactOr Competition

A quintessential challenge for any perceptual system is the need to focus on task-relevant information without being blindsided by unexpected, yet important information. The human visual system incorporates several solutions to this challenge, one of which is a reflexive covert attention system that is rapidly responsive to both the physical salience and the task-relevance of new information. This paper presents a model that simulates behavioral and neural correlates of reflexive attention as the product of brief neural attractor states that are formed across the visual hierarchy when attention is engaged. Such attractors emerge from an attentional gradient distributed over a population of topographically organized neurons and serve to focus processing at one or more locations in the visual field, while inhibiting the processing of lower priority information. The model moves towards a resolution of key debates about the nature of reflexive attention, such as whether it is parallel or serial, and whether suppression effects are distributed in a spatial surround, or selectively at the location of distractors. Most importantly, the model develops a framework for understanding the neural mechanisms of visual attention as a spatiotopic decision process within a hierarchy and links them to observable correlates such as accuracy, reaction time, and the N2pc and PD components of the EEG. This last contribution is the most crucial for repairing the disconnect that exists between our understanding of behavioral and neural correlates of attention

The attentional blink impairs detection and delays encoding of visual information: Evidence from human electrophysiology

This article explores the time course of the functional interplay between detection and encoding stages of information processing in the brain and the role they play in conscious visual perception. We employed a multitarget rapid serial visual presentation (RSVP) approach and examined the electrophysiological P3 component elicited by a target terminating an RSVP sequence. Target-locked P3 activity was detected both at frontal and parietal recording sites and an independent component analysis confirmed the presence of two distinct P3 components. The posterior P3b varied with intertarget lag, with diminished amplitude and postponed latency at short relative to long lags—an electroencephalographic signature of the attentional blink (AB). Under analogous conditions, the anterior P3a was also reduced in amplitude but did not vary in latency. Collectively, the results provide an electrophysiological record of the interaction between frontal and posterior components linked to detection (P3a) and encoding (P3b) of visual information. Our findings suggest that, although the AB delays target encoding into working memory, it does not slow down detection of a target but instead reduces the efficacy of this process. A functional characterization of P3a in attentive tasks is discussed with reference to current models of the AB phenomenon